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Abstract 


We present a novel algorithm, named the 2D-FFAST to compute a sparse 2D-Discrete Fourier 
Transform (2D-DFT) featuring both low sample complexity and low computational complexity. The 
proposed algorithm is based on mixed concepts from signal processing (sub-sampling and aliasing), 
coding theory (sparse-graph codes) and number theory (Chinese-remainder-theorem) and generalizes the 
1D-FFAST|^ algorithm recently proposed by Pawar and Ramchandran Ul to the 2D setting. Concretely, 
our proposed 2D-FFAST algorithm computes a fc-sparse 2D-DFT, with a uniformly random support, of 
size N = Nj; X Ny using 0{k) noiseless spatial-domain measurements in 0{k\ogk) computational time. 
Our results are attractive when the sparsity is sub-linear with respect to the signal dimension, that is, when 
k ^ oo and k/N 0. For the case when the spatial-domain measurements are corrupted by additive 
noise, our 2D-FFAST framework extends to a noise-robust version in sub-linear time of O(fclog^iV) 
using 0{k\og^ N) measurements. Simulation results, on synthetic images as well as real-world magnetic 


resonance images, are provided in Section VII and demonstrate the empirical performance of the proposed 
2D-FFAST algorithm. 


I. Introduction 

In many imaging applications, such as magnetic resonance angiography, computed tomography, and 
astronomical imaging, the image of interest has a sparse representation in the Fourier domain. Recent 
results in compressed sensing ||2l O allow us to exploit this sparse structure to acquire and reconstruct 
signals from far fewer measurements than required hy the Shannon-Nyquist theorem. However, the 

'Two-dimensional Fast Fourier Aliasing-based Sparse Transform 

^Fast Fourier Aliasing-based Sparse Transform 


September 22, 2015 


DRAFT 



2 


most popular class of compressed sensing based reconstruction algorithms involves alternating iteratively 
between the spatial domain representation and the Fourier domain representation of the signals, and 
consequently are computationally expensive. Hence, such algorithms have limited scope in devices and 
acquisition systems demanding inexpensive, low-power or real-time signal analysis. 

While many algorithms with low computational complexity llH |5J IB El El El EHl IHl have been proposed 
to compute a sparse ID discrete-Fourier-transform (DFT), extensions of these algorithms to 2D sparse 
signals, with recovery guarantees similar to ID, are non-trivial and very few 2D algorithms iHTl [121 
have been proposed. Yet multidimensional signals, such as images and videos, often have much sparser 
representations than ID signals and can be found in a wide range of sparse signal processing applications. 
Many imaging applications further require the ability to reconstruct the sparse image using only a few 
measurements in the Fourier domain so as to reduce imaging costs, such as acquisition time in magnetic 
resonance imaging or radiation dose in computed tomography. Hence, a practically feasible algorithm 
with both low computational complexity and low sample complexity for computing a sparse 2D-DFT is 
of great interest. 

In this work, we present an algorithm, named the 2D-FFAST (Fast Fourier Aliasing-based Sparse 
Transform), to compute a sparse 2D-DFT with both low sample complexity and computational complexity. 
The proposed algorithm generalizes the ID-FFAST approach in Pawar and Ramchandran |[T1 to the 2D 
setting in two cases: the first case is when the 2D signal dimensions and Ny are co-prime, that is 
their greatest common divisor (gcd) is 1. In this case, there is a unique one-to-one mapping between 
the ID-DFT and 2D-DFT and in Section |I3 we show that the ID-FFAST described in Pawar and 
Ramchandran |[T1 can be used in a straightforward manner. 

Our key contribution is the design of the 2D-FFAST algorithm for the second and more general case, 
in which we consider a wider class of 2D signals as described in Section Although in this case, the 
2D-DFT cannot be trivially mapped into a ID-DFT, we show that the ID-FFAST architecture can still 
be lifted to the 2D setting as shown in Section [V] and hence the recovery guarantees are preserved as 
well. 

At a high level, the 2D FFAST algorithm induces sparse graph codes in the 2D-DFT domain via 
a Chinese-Remainder-Theorem (CRT)-guided 2D sub-sampling operation in the spatial-domain. The 
resulting sparse graph codes are then exploited to devise a fast and iterative onion-peeling style algorithm 
that computes 2D-DFT, while achieving both low sample complexity and low computational complexity. 
A simplified visual illustration of the mechanics of the 2D-FFAST architecture is provided in Figure [T] 
and m 
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Fig. 1. A simplified visual illustration of how the 2D-FFAST algorithm computes a 2D sparse DFT. The 2D-FFAST algorithm 
uniformly subsamples the 2D signal with different sampling factors, thereby producing different aliasing patterns in the DFT 
domain. Each aliased DFT provides unique and independent information about the sparse DFT coefficient and can be viewed 
as a sparse graph. The 2D-FFAST algorithm uses all the aliased 2D-DFTs together to reconstruct the full 2D spectrum via an 
onion-peeling style algorithm as described in Section [V] 


Performance-wise, for the case when the signal-domain samples are observed without any noise, 
our proposed 2D-FFAST algorithm computes a fc-sparse 2D-DFT of size N = Nx x Ny, using 0{k) 
measurements in 0{klogk) computations for k = o{N), that is when k ^ oo and k/N —)• 0. Further, 
when the observed spatial-domain samples are corrupted by additive white Gaussian noise, the 2D- 
FFAST framework computes a /c-sparse 2D-DFT in sub-linear time of 0{klog^ N) using 0{klog^ N) 
measurements. 

Before diving into the main results, we emphasize the following caveats of our algorithm and analysis: 

1) Our proposed 2D-FFAST algorithm does not apply to arbitrary 2D signal dimensions but only to 
a selected but arbitrarily large set of dimensions as described in Section |I^ However, as we have 
demonstrated in the same section, two dimensional choices that are close to a user desired dimension 
and satisfy the 2D-FFAST requirement can be found. 

2) Our analytical results are probabilistic and hold for asymptotic values of k and signal dimensions 
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Nx X Ny, with a success probability that approaches 1 asymptotically. 

3) Our analytical results also assume a uniformly random model for the support of the non-zero DFT 
coefficients, which does not describe real-world signal accurately. 

4) For the noisy case, we assume that the non-zero DFT coefficients belong to an arbitrarily large 
but finite constellation such that the effective signal-to-noise ratio is finite for analysis purpose. 
However, as we will show in the simulation section (Section [VII| ), our 2D-FFAST simulation results 
on synthetic images as well as real world magnetic resonance images (MRI) show good empirical 
performance even though though these signals have a non-uniform support for the dominant DFT 
coefficients that further take values from arbitrary complex constellations. 



Fig. 2. A visual illustration of how the 2D-FFAST algorithm transforms different aliasing patterns into a balls-and-bins sparse 
graph. This effectively transforms the 2D sparse DFT problem into a sparse graph decoding problem. 


A. Related Work 

A number of previous works ||4l HI |6l |7l HI HI [TOl [II have addressed the problem of computing a 
ID DFT of an A^-length signal that has a fe-sparse Fourier transform, in sub-linear time and sample 
complexity. Most of these algorithms achieve a sub-linear time performance by first isolating the non¬ 
zero DFT coefficients into different groups/bins, using specific filters. The non-zero DFT coefficients 
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are then recovered iteratively, one at a time. The filters used for the binning operation are typically of 
length 0{klogN). As a result, the sample and the computational complexity is 0{k log N) or more 
even for noiseless measurements. The ID-FFAST algorithm in Pawar and Ramchandran |[T1 is the first 
algorithm to compute a A:-sparse ID-DFT of an A^-length signal using 0{k) measurements and 0{k log k) 
computations for noiseless measurements. The ID-FFAST algorithm is further extended in IT^ to additive 
Gaussian noise corrupted measurements using 0{klog^ N) measurements. 

Unlike ID-DFT, there are very few algorithms designed for multi-dimensional DFT. The algorithm in 
Gilbert et al. ||5l achieves 0{k log'^ N) sample and time complexity for computing a fc-sparse N = x Ny 
2D-DFT, where c is some positive constant. In Ghazi et al. ifT^ . the authors propose a sub-linear time 
algorithm for computing a A:-sparse 2D-DFT for 2D signals with equal dimension with Nx = Ny = y/N, 
where the dimensions are powers of 2. For noiseless measurements with k = 0{y/N), the algorithm uses 
0{k) measurements and 0{klogk) time. For the general sub-linear sparsity regime the computational 
complexity is 0{klogk+k{loglogNy) for some constant c. The algorithm also succeeds with a constant 
probability that does not approach 1, which generally translates to inferior empirical results as well. In 
Indyk et al. |[TT]| . the proposed algorithm achieves 0{k\ogN) sample complexity and 0{Nlog^ N) 
computational complexity for general sub-linear sparsity k. 

In contrast, the 2D-FFAST algorithm is the first to compute an exactly /c-sparse N = Nx x A^^-point 
DFT that has all of the following features: 

• it has 0{k) sample complexity and 0{k\ogk) computational complexity for noiseless observations 

• it can compute a noise robust fc-sparse 2D-DFT in sub-linear time of 0{k log^ N) using 0{k log^ N) 
measurements. 

• it covers the entire sub-linear regime (k oc N^,0 < 5 < 1) 

• it has a probability of failure that vanishes to zero asymptotically in the problem dimension N. 

II. Signal model and problem formulation 

In this section, we describe our signal model and problem formulation in detail. Specifically, we 
consider a 2D signal x G that is a sum of k complex exponentials: 

k-l 

x[a][b] = J]] (1) 

t=o 

where the spatial indices 0 < a < Nx — 1,0 < b < Ny — 1, the discrete frequencies {ut,vt) G 
{(0, 0),. .., {Nx — l,Ny — 1)} and the amplitudes X[ui][i;t] G C. 
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Our signal model assumes that the number of complex exponentials, hence the number of non-zero 2D- 
DFT coefficients, is sub-linear with respect to the signal dimension, that is A: oc N^, where N = Nx x Ny 
and 0 < 5 < 1. 

In addition, our 2D-FFAST algorithm requires that the 2D signal dimension N = Nx x Ny can be 
factorized into d factors where d is an appropriately chosen constant (usually chosen as 3) and 

each factor is on the order of with the factors {Qi}flQ being pairwise co-prime. That is, 

N = QoQi • • • Qd-i (2) 

where Qi ~ gcd(Qi, Qj) = 1 for f / j. 

We note that the dimension assumption is also required by the ID-FFAST and hence we impose no 
additional constraint on the 2D signal dimension {Nx, Ny) other than that the total dimension N = Nx x 
Ny satisfies the ID-FFAST dimension requirement. While the dimension assumption limits the application 
to arbitrary 2D dimensions, this constraint is flexible in practice as long as the user has reasonable control 
on the signal dimension. For example, suppose we want to target a 2D DFT computation with dimension 
N = Nx X Ny around 512 x 256 and sparsity k ss 2500 ss Then choosing d = 3, we have each 

factor Qi ps 50. Hence, we can choose Qo = 49, Qi = 50, Q 2 = 51, and split the factors between Nx 
and Ny to obtain Nx = 51 x 10 = 510 and = 5 x 49 = 245, which are close to the targeted 2D 
signal dimension. 

For noisy observations, we assume an additive Gaussian noise model, where the observed spatial- 
domain sampled y are corrupted by white Gaussian noise, that is, 

y = x + z (3) 

where 2 : G CAA(0, 1) ( complex Gaussian i.i.d. noise ) 

Further, we assume that all the non-zero 2D-DFT coefficients belong to a finite constellation set such 
that the effective signal-to-noise ratio is finite, that is, A = {ae*‘*’|a G Af, i;f> G ‘h}, where: 

• M = {^p/2 + k^p/Mi}^^^ 

. CD = {27rA/M2}^V' 

• p is a desired signal-to-noise ratio, which is defined as p = MfuJpl/ElUzlP/A} 

• Ml, M 2 are some constants. 

The finite constellation assumption is purely for analysis purpose and does not influence the algorithm 
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implementation in practice. 

The 2D-FT'AST framework proposed in this paper is an extension of the ID-FFAST architecture from 
m, hence for ease of exposition, we closely follow the notations used in lU, which are summarized in 
Table HI 


Notation 

Description 


Ambient signal size in each of the 2 dimensions respectively. 

N 

Ambient signal size N = N^Ny 

k 

Number of non-zero coefficients in the 2D-DFT X. 

6 

Sparsity-index: k oc , 0 < 5 < 1. 

m 

Sample complexity: Number of measurements of x used by the 2D-FFAST 

algorithm to compute the 2D-DFT X. 

r = m/k 

Oversampling ratio: Number of measurements per non-zero DFT coefficient. 

d 

Number of stages in the “sub-sampling front end” of the 2D-FFAST architecture. 


TABLE I 

Glossary of important notations and definitions used in the rest of the paper. 


We now descrihe the Chinese-Remainder-Theorem (CRT) which plays an important role in our proposed 
2D-FFAST architecture. For integers a, n, we use (a)„ to denote the modulo operation, that is, (a)„ = a 
mod n. 

Theorem II.l (Chinese-Remainder-Theorem 1(141 ). Suppose no, ni,..., n^-i are pairwise co-prime 
positive integers and N = Hto Then, every integer ‘a’ between 0 and N — \ is uniquely represented 
by the sequence rg, ri,..., r^-i of its remainders modulo no,..., na-i respectively and vice-versa. 

Further, given a sequence of remainders ro,ri,... ,rd-i, where 0 < r* < n^. Gauss’s algorithm can 
he used to find an integer ‘a’, such that, 

{a)rn^ri for i = 0,1,... ,ci - 1. (4) 

III. Main Result 

Given the signal model in Section |T^ we propose a 2D-FFAST algorithm for computing a fc-sparse 
2D-DFT with noiseless observations. For noisy observations, we describe a robust extension of the 2D- 
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FFAST called 2D-R-FFAST that aims at robustifying 2D-FFAST that achieves sub-linear computational 
complexity with (slightly) higher sample complexity for noise robustness. Table |I^ summarizes the noise 
model, sample complexity and computational complexity for the proposed algorithms. 


Algorithm 

2D-FFAST 

(See Section V i 

2D-R-FFAST 

(See Section VI i 

Noise model 

Noiseless 

Noisy with sufficiently high 
SNR 

Sample complexity 

0{k) 

0{k log^ N) 

Computational complexity 

0{klogk) 

0{k log"^ N) 


TABLE II 

Summary of sample and computational complexity eor proposed algorithms 


Concretely, consider the signal model as stated in Section [T^ our main results are given by the following 
theorems: 


Theorem For any 0 < <5 < 1, and large enough N = N^Ny, the 2D-FFAST algorithm computes 

the k-sparse 2D-DFT of an {Nx x Ny)-size input x, where k = 0{N^), with the following properties: 

1) Sample complexity: The algorithm needs m = 0{k) measurements 

2) Computational complexity: The computational complexity of the 2D-FFAST algorithm is 0(mlog(m)) 

3) Probability of success: The probability that the algorithm correctly computes the k-sparse 2D-DFT 
X is at least 1 — 0(l/m) . 


Proof: For the case when Nx and Ny are co-prime, there exists a unique one-to-one mapping from 
2D-DFT to a ID-DFT as shown in Section IV For the general case, in Appendix]^ we show that there 
exists a one-to-one mapping from a 2D-FFAST architecture to a ID-FFAST architecture. ■ 


Theorem III.2. For a sufficiently high signal-to-noise-ratio, any 0 < <5 < 1, and a large enough N = 
NxNy, the 2D-R-FFAST algorithm computes the k-sparse 2D-DFT of an [Nx x Ny)-size input x, where 
k = O(N^), with the following properties: 

1) Sample complexity: The algorithm needs m = 0{klog^{N)) measurements 

2) Computational complexity: The computational complexity of the 2D-FFAST algorithm is 0{k log^(A^)) 


September 22, 2015 


DRAFT 
















9 


3) Probability of success: The probability that the algorithm correctly computes the k-sparse 2D-DFT 
X is at least 1 — 0(l/m) . 


Proof: Please see Appendix for the proof for theorem III.2 


Note, that although the main results are for asymptotic values of k, it applies for any signal that has 
||X||o < k. Hence, the regime of 5 = 0 (esp. constant k) is covered hy the 2D-FFAST algorithm designed 
to operate for any 5 > 0, at the expense of being suh-optimal. 


IV. FFAST Architecture for 2D Signals with co-prime dimensions 

We first discuss a simple extension of the ID-FFAST lUl to the 2D setting for the case when the 
dimensions and Ny are co-prime. When the dimensions are co-prime, there exists a one-to-one 
mapping between a 2D signal and a ID signal, such that the 2D-DFT of a 2D signal can be computed 
using the ID-DFT of the mapped ID signal. Hence, one can use the ID-FFAST architecture proposed 
in (H off-the-shelf, in conjunction with this mapping, to compute the fe-sparse 2D-DFT. 
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Fig. 3. Architecture for computing the 2D-DFT of a 2D signal with co-prime dimensions, e.g., = 4, Ny = 5. First, we 

use a forward mapping based on the Chinese-Remainder-Theorem (CRT) to convert a 2D signal x in to a ID signal x. Then, 
we use our ID-FFAST architecture to compute the ID-DFT, X. We transform back the result from ID-DFT X, using a reverse 
mapping based on Good-Thomas algorithm, to get the 2D-DFT X. 


We will use an example to illustrate the mapping. Consider an example signal x G that has 

a sparse 2D-DFT. We use the Chinese-Remainder-Theorem (CRT) based forward mapping HHHSl, to 
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obtain a ID signal x from the 2D signal x as follows: The ID vector x is constructed by reading out 
the measurements from the 2D signal x in a diagonally downward direction, towards right, starting from 
top left comer as shown in Fig. A uniformly random support in 2D-DFT corresponds to a uniformly 
random support in CRT mapped ID-DFT Hence, we use the ID-FFAST architecture from |[T1, to compute 
the sparse ID-DFT, X. Then, we perform the reverse mapping of ID-DFT X to the 2D-DFT X using 
the Good-Thomas algorithm ifTSl [TQ. The elements of the ID vector X are read out sequentially and 
placed in a diagonally downward direction, but towards left, starting from the top-left corner as shown 
in Fig. 1^ 

In nsiiisi, the authors show that the forward and the reverse mapping can be done as long as the 
dimensions are co-prime. Hence, for the signals with co-prime dimensions, the sparse 2D-DFT can be 
computed using the ID-FFAST algorithm of (Tl, along with the forward and reverse mapping from 

|[I51[I61. 


V. FFAST ARCHITECTURE FOR GENERAL 2D SIGNALS 

While a sparse 2D-DFT with co-prime dimensions can be computed using the ID-FFAST, co-prime 
dimensions can be restrictive and exclude many signals, such as square images. In the following, we 
describe a 2D-FFAST architecture that can compute a sparse 2D-DFT for a more general class of 
dimensions as described in Section ini 

At a high level, the 2D-FFAST architecture consists of a deterministic sub-sampling “front-end” and 
an associated “back-end” peeling-decoder algorithm as shown in Fig Throughout the section, we will 
use a simple example to illustrate the 2D-FFAST framework. 

We choose our example signal to be a 6 x 6 2D signal x, such that its 2D-DFT X is 4-sparse. Let 
the 4 non-zero 2D-DFT coefficients of x be X[l][3] = 7, X[2][0] = 3,X[2][3] = 5 and X[4][0] = 1. The 
2D-FFAST ‘front-end’ sub-samples the input signal and its circularly shifted version through multiple 
stages d. Each stage, further has D = 3 delay paths and is parametrized by a single sampling factor. 
For example, the 2D-FFAST architecture of Fig. has d = 2 stages and 3 delay (circular shift) paths 
per stage. Let {nx,i,ny^i) denote the sampling factor of stage i, e.g., in Fig. Uxfl = riyfl = 3 and 
nx,i = riy^i = 2. Stage i of the 2D-FFAST front-end samples the input signal x and its 3 circular shifts, 
x(o,o)^x(i-“),x(0’i),by {nx^i,ny^i), in each of the two dimensions. The 2D-FFAST algorithm synthesizes 
the big 2D-DFT X, from the short 2D-DFT of each of the sub-sampled stream, using the peeling- 


decoder. In Section V-1 we describe in detail, the operation of the block matrix-to-bin observations, 
which essentially groups the output of the short DFTs in a specific way. 
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FFAST front-end 


FFAST 

back-end 



Fig. 4. A 2D-FFAST architecture of d = 2 stages. Each stage further has 3 delay chains and a common suh-sampling factor. 
The smaller 2D-DFTs are computed of the output of each suh-sampler. Then, hin-ohservations are formed by collecting one 
scalar output from each of the 3 delay chains. The bin-observations are further processed by a ‘peeling-decoder’ to reconstruct 
the large 2D-DFT X. 


Before we describe how to compute the 2D-DFT of the signal x, using the 2D-FFAST framework, we 
review some basic signal processing properties of subsampling-aliasing and circular shifts. In Fig. we 
show a detailed view of stage 0 of the 2D-FFAST architecture of Fig. 

• Sub-sampling and aliasing: If a 2D signal is subsampled in the spatial domain, its 2D-DFT 
coefficients mix together, that is, alias, in a pattern that depends on the sampling procedure. For 
example, consider uniform subsampling of x ^ 3 in both the dimensions. The sub-sampling 

I / \ 

x[0][0] x[0][3] 


operation in the first path or delay chain of Fig. 


5 


results in Xg = 


. Then, the 


x[3][0] x[3][3] 


2D-DFT coefficients of Xg are related to the 2D^FT coefficients X as: 
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X, [0] [0] = X [0] [0] +X[2][0]+X [4] [0] + X [0] [2] + X [2] [2] 
+ X[4][2] +X[0][4] +X[2][4] +X[4][4] =4 
X,[0][1] = X[0][l]+X[2][l]+X[4][l]+X[0][3]+X[2][3] 
+ X[4][3]+X[0][5]+X[2][5]+X[4][5] = 5 
X,[1][0] = X[l][0]+X[3][0]+X[5][0]+X[l][2]+X[3][2] 
+ X[5][2] +X[1][4] +X[3][4] +X[5][4] =0 
X,[l][l] = X[l][l]+X[3][l]+X[5][l]+X[l][3]+X[3][3] 
+ X[5][3]+X[l][5]+X[3][5]+X[5][5] = 7 


More generally, if the sampling periods of the row and columns of the 2D-signal x are no and ni 
(we assume that no divides and ni divides Ny) respectively, then, 

Xs[m= E (5) 

i=(a)jVa,/no ,j=(b)jvy/n-i 

where notation i = {a)N^/no’ denotes i = a mod (Nx/no). 

• Circular spatial shift: A circular shift in the spatial domain results in a phase shift in the fre¬ 
quency domain. Consider a circularly shifted signal (each column is circularly shifted hy 

1) obtained from x as = x\{i + l)iv^][j]- Then the 2D-DFT coefficients of the shifted 

signal are given as, 2f[z][j], where = exp(27rz/A"x). Similarly, the 2D-DFT 

coefficients of a circularly shifted sequence x*^°d) obtained from x as = x[f][(y + l)Afs,]> 

are X(04)[i][y] = X[f][j], where uj^y = exp(27rz/Aj^). In general, a circular shift of (si,S 2 ) 

results in X^^^’^^^\i][j] = [f][j]. 

Using the above signal processing properties of sub-sampling and spatial circular shift, we compute the 
relation between the 2D-DFT coefficients X and the output of stage 0 (shown in Fig. of the 2D-FFAST 
front-end. Next, we group the output of the 2D-FFAST front end into “bin-observation” as follows: 

1) Bin observation: A bin observation is a 3-dimensional vector formed by collecting one scalar 
output value from each of the 3 delay chains in a stage of the 2D-FFAST front-end. For example, yb,o,o 
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Fig. 5. A detailed view of stage 0 of the 2D-FFAST architecture of Fig.|^ A 2D signal x and its 2D circularly shifted versions 
are subsampled by (3,3) to obtain the sub-sampled signals and Xg’^. Then, the 2D-DFT of the sub-sampled signal 

is computed and the outputs are collected to form bin-observations. 


is an observation vector of bin 0 in stage 0 of the 2D-FFAST front-end and is given by, 


yb,o,o 




( 6 ) 


Note, that there are total of 4 bins in stage 0 shown in Fig. The bins are indexed by a single number 
as follows: a bin formed by collecting the scalar outputs indexed by (i,j) from each of the delay chains 
is labelled {Nxino) x i+j, e.g., all the delay chain outputs indexed by (1, 0) form the observation vector 
of bin 2 of stage 0 (also see Fig. [^, and is denoted by 


yb,0,2 




Next, using the above 6x6 example signal x, we explain how to compute a sparse 2D-DFT of a 
signal using decoding over an appropriately designed sparse graph. 

2) Computing a sparse 2D-DFT via decoding on a sparse-graph: Let the 6x6 example signal x be 
processed through the 2-stage 2D-FFAST architecture of Fig. Then, the relation between the resulting 
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stage-0 


X|41|0] 


X|21|0] 


Xlllp] 


X|21|3] 



Fig. 6. A bi-partite graph representing the relation between the bin-observations and the non-zero 2D-DFT coefficients X. 
Left nodes in the graph represent the non-zero 2D-DFT coefficients and the right nodes represent the “bins” (we sometime refer 
them also as check nodes) with vector observations. An edge connects a left node to a right check node iff the corresponding 
non-zero 2D-DFT coefficient contributes to the observation vector at that particular check node, e.g., the 2D-DFT coefficient 
A[4][0] contributes to the observation vector of bin 0 of stage 0 and bin 3 of stage 1. A zeroton check node has no left neighbor. 
A singleton check node has exactly one left neighbor and a multiton check node has more than one left neighbors in the graph. 


bin-observations and the non-zero 2D-DFT coefficients X can be computed using the sub-sampling and 
the circular shift properties explained earlier and is graphically represented in Fig. Left nodes of the 
graph in Fig. represent the non-zero DFT coefficients and the right nodes represent the “bins” (check 
nodes) with vector observations. An edge connects a left node to a right check node iff the corresponding 
non-zero 2D-DFT coefficient contributes to the observation vector of that particular check node, e.g., after 
aliasing, due to sub-sampling, the 2D-DFT coefficient X[4][0] contributes to the observation vector of 
bin 0 of stage 0 and bin 3 of stage 1. 

We define the following: 

• zero-ton: A bin that has no contribution from any of the non-zero DFT coefficients of the signal, 
e.g., bin 2 of stage 0 or bin 0 of stage 1 in Fig. A zero-ton bin can be trivially identified from 
its observations. 

• single-ton: A bin that has contribution from exactly one non-zero DFT coefficient of the signal, e.g., 
bin 1 of stage 0. Using the signal processing properties the observation vector of bin 1 of stage 0 


September 22, 2015 


DRAFT 














15 


is given as, 


/ 


Ub,0,1 = 


X[2][3] 
g27r*2/6^[2] [3] 


V 


r,27n. 


3/6x[2][3] 


The observation of a singleton bin can be used to determine the 2D support and the value, of the 
only non-zero DFT coefficient contributing to that bin, as follows: 

- Row support: The row-support of the non-zero DFT coefficient contributing to a singleton bin 
can be computed as, 

2 = ^Zyk,o,i[l]ylo,iM (7) 


- Column support: The column-support of the non-zero DFT coefficient contributing to a singleton 
bin can be computed as, 

3 = ^ZyM,i[2]4o.i[0] (8) 


- Value: The value of the non-zero DFT coefficient is given by the observation 
We refer to this procedure as a “ratio-test”, hence forth. Thus, a simple ratio-test on the observations 
of a singleton bin correctly identifies the 2D support and the value of the only non-zero DFT 
coefficient connected to that bin. This property holds for all the singleton bins. 

• multi-ton: A bin that has contribution from more than one non-zero DFT coefficients of the signal, 
e.g., bin 0 of stage 0. The observation vector of bin 0 of stage 0 is. 


2 / 6 , 0,0 


X[4][0]+X[2][0] 

g27r*4/6j^[4][Q] 

^ X[4][0]+X[2][0] 


—2 -|- z\/3 

l " ) 


Now if we perform the “ratio-test” on these observations, we get the column support to be 1.3484. 
Since we know that the column support has to be an integer value between 0 to 5, we conclude that 
the observations do not correspond to a singleton bin. In ||T|, we rigorously show that the ratio-test 
identifies a multi ton bin almost surely. 

Hence, using the “ratio-test” on the bin-observations, the 2D-FFAST decoder can determine if a bin 
is a zero-ton, a single-ton or a multi-ton, almost surely. Also, when the bin is singleton the ratio-test 
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provides the 2D-support as well as the value of the non-zero DFT coefficient connected to that hin. We 
use the following peeling-decoder on the graph in Fig. to compute the support and the values of the 
non-zero DFT coefficients of x. 

Peeling-Decoder: The peeling-decoder repeats the following steps: 

1) Select all the edges in the graph with right degree 1 (edges connected to singleton bins). 

2) Remove these edges from the graph as well as the associated left and the right nodes. 

3) Remove all other edges that were connected to the left nodes removed in step-2. When a neighboring 
edge of any right node is removed, its contribution is subtracted from that bins observation. 

Decoding is successful if, at the end, all the edges have been removed from the graph. It is easy to verify 
that performing the peeling procedure on the graph of Fig. results in successful decoding with the 
coefficients being uncovered in the following possible order: X[2][3],X[1][3],X[4][0],2 l[2][0]. 

Thus, the 2D-FFAST architecture of Fig. has transformed the problem of computing a 2D-DFT of a 
signal X into that of decoding over a sparse graph of Fig. induced by the sub-sampling operations. The 
success of the peeling-decoder depends on the properties of the induced graph. In Appendix we show 
that, if the sub-sampling parameters are chosen carefully, guided by the Chinese-Remainder-Theorem 
(CRT), the 2D-FFAST decoder succeeds with probability approaching 1, asymptotically in k. 

VI. Noise Robust 2D-FFAST Algorithm 

In this section, we provide a brief overview of robust extensions of 2D-FFAST. The robustness against 
sample noise is achieved by a simple modification to the 2D-FFAST framework. Specifically, the 2D- 
FFAST front-end in Section [V] has multiple stages of sub-sampling operations, where each stage further 
has 3 delay-chains to estimate the location of the singletons. For noiseless observations, the location 
estimation for each dimension is done by two separable ratio-tests. However, for noisy observations, the 
ratio-test becomes unreliable and more measurements are needed for a robust support estimation. Hence, 
to become robust to sample noise, we modify the front end by increasing the number of delay-chains 
and modify the back-end by replacing the ‘ratio-test’ with a more sophisticated singleton estimator. 

In lfT3l . we have shown that a noiseless ID-FFAST framework can be made noise-robust by using 
0(log^ N) number of delay-chains per sub-sampling stage, achieving sub-linear computational complex¬ 
ity. Since for 2D-DFT, we follow a separable approach and perform 2 independent ratio-tests to determine 
the 2D support of a single-ton bin, all the results from llT3]l follow. With O(log^A^) specially designed 
delays, the 2D-R-FFAST algorithm computes a fc-sparse 2D-DFT in sub-linear time of 0{k log^ N) using 
0{k log^ N) measurements. 
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VII. Simulations 

In this section we validate the empirical performance of the 2D-FFAST architecture for a range of 
settings gradually varying from synthetic signals, generated using the signal model specified in the paper, 
to real world MR images. In Section VII-A[ we provide simulations for synthetic 2D signals with an 


exactly sparse 2D-DFT and compare it with the theoretical claims of this paper. In Section VII-B 


we evaluate our 2D-FFAST algorithm on synthetically generated ‘Cal image’ and ‘house image’ (see 
Fig. 0 that although are exactly sparse, do not have uniformly random support for the non-zero DFT 
coefficients. Later in Section VII-C, we showcase the noise robustness of our algorithm using the noisy 
”cal image” as an input to our algorithm. Lastly, in Section VII-D, we show an application of the 2D- 
FFAST architecture to acquire Magnitude Resonance Imaging (MRI) data, which is not exactly sparse 
and also has a structured, rather than a uniformly random, support for the dominant 2D-DFT coefficients. 
Thus, providing an empirical evidence that the 2D-FFAST architecture is applicahle to realistic signals, 
although the theoretical claims are only for signals with an exactly sparse 2D-DFT with uniformly random 
support. 

In the spirit of reproducible research, we provide a software package to reproduce most of the results 
described in this paper. The software package can be downloaded from: 

https://www.eecs.berkeley.edu/~kannanr/project_ffft.html 


A. Application of 2D-FFAST for signals with exactly k-sparse 2D-DFT 

Figure |7] shows a probability of success plot (phase transition curve) generated from simulations. The 
plot demonstrates the number of samples required to perfectly reconstructed an exactly A:-sparse 2D-DFT 
in a particular setting and is in close agreement with the theoretical results as described in |[T]. The details 
of the simulation are as follows: 

• Very sparse regime 0 < <5 < 1/3: We construct a 2D signal x of ambient dimensions = Ny = 
2520. The sparsity parameter k is varied from 70 to 170 which corresponds to the very-sparse regime 
of k < where N = N^Ny = 6.35 million. We use a 4 stage 2D-FFAST architecture (see 

Fig. 1^ for reference). The uniform sampling periods for each of the 4 stages are (5 x 7 x 8)^, 
(7 X 8 X 9)^, (8 X 9 X 5)^ and (9 x 5 x 7)^ respectively. Thus the number of bins/check-nodes 
in the 4 stages are 9^, 5^, 7^ and 8^ respectively. Further, each stage has 3 delay sub-streams. 
Thus, the total number of measurements used by the 2D-FFAST algorithm for this simulation is 
m < 3(9^ -|- 5^ -|- 7^ -|- 8^) = 657. We define rj as an average number of bins per stage normalized 
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per sub-stream normalized by 
the number of non-zero coefficients k 


Fig. 7. The probability of success of the 2D-FFAST algorithm as a function of rj, the average number of bins per stage 
normalized by the number of non-zero coefficients k. The plot is obtained for the two different sparsity regimes: 1) Very- 
sparse regime, that is, <5 < 1/3. For this regime, a d = 4 stage 2D-FFAST architecture is used; 2) Less-sparse regime, that is, 
1/3 < d < 1. For this regime, a d = 3 stage 2D-FFAST architecture is used. Each point in the plot is obtained by averaging 
over 100 runs of the simulations. The ambient signal dimension N^. x Ny, and the number of measurements m are fixed in 
both the simulations, while the number of the non-zero 2D-DFT coefficients fc, is varied to get different values of r/. We note 
that the 2D-FFAST algorithm exhibits a threshold behavior with the thresholds rji = 0.38 and 772 = 0.47 for the very-sparse 
and the less-sparse regimes respectively. From (T), we know that the optimal thresholds for a d = 4 and d = 3 stage ID-FFAST 
architecture are rji — 0.3237 and 772 = 0.4073 respectively. Thus, confirming that the empirical behavior of the 2D-FFAST 
architecture is in close agreement with the theoretical results. 


by the sparsity k. For example, when k = 100 the value of 77 = 0.5475. In HI, we have shown 
that for a 4-stage ID-FFAST architecture the theoretical threshold rj* = 0.3237. We observe that the 
2D-FFAST algorithm also shows a threshold behavior and successfully reconstructs the 2D-DFT for 
all values of 77 > 0.38, which is in close agreement with the theoretical claims. 

• Less sparse regime 1/3 < 5 < 1: We construct a 2D signal x of ambient dimensions Nx = Ny = 
280. The sparsity parameter k is varied from 2000 to 5000 which corresponds to the less-sparse 


September 22, 2015 


DRAFT 







19 


regime, 0{N'^/^) < k < 0{N^/'^), where N = N^Ny = 78400. We use a d = 3 stage 2D-FFAST 
architecture (see Fig. for reference). The uniform sampling periods for each of the 3 stages are 
5,8 and 7 respectively. Thus the number of hins/check-nodes in the 3 stages are 35^, 56^ and 40^ 
respectively. Further, each stage has 3 delay suh-streams. Thus the total number of measurements 
used by the 2D-FFAST algorithm for this simulation is m < 3(35^ + 56^ + 40^) = 17883. From 
ifn . for a 3 stage ID-FFAST architecture, the theoretical threshold rj* = 0.4073. We observe that 
the 2D-FFAST algorithm successfully reconstructs the 2D-DFT for all values of rj > 0.47, which is 
in close agreement with the theoretical thresholds. 

• For each run of the simulation, a 2D-DFT X of dimension x Ny is generated, with exactly k 
non-zero coefficients. The support of the non-zero DFT coefficients is chosen uniformly at random 
from the set {0,1, ...,Nx — 1} x {0,1, ...,Ny — 1}. The spatial 2D signal x is then generated from X 
using an inverse 2D-DFT operation. This discrete signal x is then given as an input to the 2D-FFAST 
front-end. 

• Each sample point in Fig. [^is generated by averaging over 100 runs of the simulations. 

• Decoding is successful if all the 2D-DFT coefficients are recovered perfectly. 

Figurej^shows the empirical run-time of the 2D-FFAST with k = 100,200, 300 and ambient dimension 

Nx varied from 315 to 5985 with Ny held fixed af 315. We used a d = 3 sfage 2D-FFAST architecfure 
wifh 3 delays per sfage. Each problem insfance was run 1000 limes, and fhe averaged run-lime was 
plotted. As seen from the figure, fhe empirical run-time remains constant irrespective of the growth in 
the ambient dimension Nx and only grows with the sparsity k, thus confirming our Iheorefical claim of 
compulafional complexify being independenl of ambienl dimension N. 


B. Application of 2D-FFAST for signals with exactly k-sparse 2D-DFT but with non-uniform support 

The Iheorefical guarantees of Theorem [III. 1 are for signals lhal have an exacfly /c-sparse 2D-DET, wifh 
fhe supporl of fhe non-zero DET coefficienls being uniformly random. In fhis seclion we empirically show 
lhal fhe proposed 2D-EEAST architecfure works quite well even for signals that have non-uniform support 
of the 2D-DET coefficients. We provide simulation results for two different types of images with the 
parameters specified as below. 


‘Cal’ Image: The ‘Cal’ image shown in Eig. 9(c) is a synlhetic image of size 280 x 280. The 
number of fhe non-zero pixels in fhe ‘Cal’ image is k = 3509, and fhe supporl is non-uniform. Nole, 
since fhe image is sparse in fhe spatial domain, we sub-sample in the frequency domain, that is. 


the input to the 2D-FFAST front-end is the 2D-DET of the ‘Cal’ image (see Eig. 9(a) i. We use a 3 
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Fig. 8. Empirical run-time of the 2D-FFAST for different sparsity level k with varied Nx and fixed Ny 


Stage 2D-FFAST architecture with sampling periods 5, 7 and 8 in each of the 3 stages respectively. 
The 2D-FFAST algorithm perfectly reconstructs the spatial image using m = 16668 measurements 
of its 2D-DFT domain. 


‘House’ Image: The ‘House’ image shown in Fig. 9(f) is created hy applying the Canny edge 
detection algorithm on the commonly used House image in the image processing literature. The 
‘House’ image is cropped to size 247 x 238. The number of non-zero pixels is k = 4599 and the 
support is non-uniform. Since the dimensions of the image are co-prime, we use the prime factor 


mapping of Section IV and apply the ID-FFAST algorithm to perfectly reconstruct the image using 
m = 5.46A; = 25126 measurements of its 2D-DFT domain. 
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(a) Log-intensity plot of the 2D-DFT of (b) 2D-FFAST subsampled 2D-DFT of (c) Perfectly reconstructed ‘Cal’ image 
the ‘Cal’ image of dimension 280 x 280. the ‘Cal’ image with m = 4.75fc = using the 2D-FFAST algorithm 

16668 measurements. The white pixels 
correspond to the sampled data. 



(d) Log-intensity plot of the 2D-DFT of (e) ID-FFAST subsampled 2D-DFT of (f) Perfectly reconstructed ‘House’ im- 
the ‘House’ image of dimension247 x ‘House’ image with m = 5.46fc = age using prime-factor mapping and the 
238. 25126 measurements. ID-FFAST algorithm 


Fig. 9. The figure shows the performance of the 2D and ID FFAST algorithm for signals with exactly-sparse spatial image 
domain, with non-uniform support of the non-zero pixels. The signal is sampled in the Fourier domain and the 2D-FFAST 
algorithm is used to perfectly recover the image domain data. 


C. Application of 2D-R-FFAST for signals with exactly k-sparse 2D-DFT and additive noise 

In this section, we demonstrate the application of a noise robust variant of our algorithm 2D-R-FFAST 
to reconstructing the ’Cal’ image from its noisy spatial samples. The ’Cal’ image shown in Fig. 1 10(a) 
is constructed hy adding white Gaussian noise to the ‘Cal’ image such that the SNR is 13dB. We use 
a 3 stage 2D-FFAST architecture with sampling periods 5, 7 and 8 in each of the 3 stages respectively. 
To increase noise robustness to 2D-FFAST, we increase the number of delays to 5 per dimension. The 
number of measurements is 43200. 

Figure [T0(c)| shows the 2D-R-FFAST reconstructed image. The 2D-FFAST algorithm perfectly recovers 
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(a) Noisy ‘Cal’ image with SNR = 13dB (b) 2D-FFAST subsampled 2D-DFT of (c) Reconstructed ‘Cal’ image using the 

the noisy ‘Cal’ image with m = 12.3A: = 2D-FFAST algorithm 
43200 measurements. 



(d) Difference between the noisy and (e) Difference between the 2D-FFAST 
original ‘Cal’ images. Amplified by 5 for reconstructed and original ‘Cal’ images, 
visualization Amplified by 5 for visualization. Notice 

there is zero error for the empty regions. 

Fig. 10. The figure shows the performance of the 2D FFAST algorithm for signals with exactly-sparse spatial image domain, 
with non-uniform support of the non-zero pixels and additive Gaussian noise. 


the sparse coefficient locations in the DFT domain and results in a normalized mean-squared error of 
0.0136. Figure 10(d)| and 1 10(e) show the amplified difference images for fhe noisy and 2D-FFAST 
reconsfrucfed images respectively. As seen in the figures, 2D-R-FFAST reduces noise in regions where 
fhe pixels are zero in fhe original image as it utilizes the sparsity nature of the image. 


D. Application of the 2D-R-FFAST for MR imaging 

In this section, we apply the 2D-R-FFAST algorithm to reconstruct a hrain image acquired on an 
MR scanner with dimension 504 x 504. In MR imaging the measurements are acquired in the Fourier 
domain and the task is to reconstruct the spatial image from significantly less number of Fourier 
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(a) Log intensity plot of the 2D-DFT (b) Original ‘Brain’ image in spatial (c) Reconstructed ‘Brain’ image us- 

of the original ‘Brain’ image. The red domain. ing the 2D-R-FFAST architecture along 

enclosed region is fully sampled and with the fully sampled center frequen- 

used for the stable inversion. cies. The total number of Fourier mea¬ 

surements used is 60.18%. 



(d) Log intensity plot of 2D-DFT of the (e) Differential ‘Brain’ image obtained (f) Differential ‘Brain’ image recon- 
original ‘Brain’ image, after application using the vertical difference operation structed using the 2D-FFAST algorithm 
of the vertical difference operation. on the original ‘Brain’ image. from 56.71% of Fourier measurements. 


Fig. 11. Application of the 2D-FFAST algorithm to reconstruct the ‘Brain’ image acquired on an MR scanner with dimension 
504 X 504. We first reconstruct the differential ‘Brain’ image shown in Fig. |ll(e)[ using d = 3 stage 2D-R-FFAST architecture 
with 15 random delays in each of the 3 stages of the 2D-FFAST architecture. Additionally we acquire all the Fourier measurements 
from the center frequency as shown, by the red enclosure, in Fig. |1 l(a)| Then, we do a stable inversion using the reconstructed 
differential ‘Brain’ image of Fig. |ll(f)| and the fully sampled center frequencies of Fig. |ll(a)l to get a reconstructed full ‘Brain’ 
image as shown in Fig. |1 l(c^ Our proposed two-step acquisition and reconstruction procedure takes overall 60.18% of Fourier 
measurements. 


measurements El. To reconstruct the full brain image using 2D-R-FFAST, we perform the following 
two-step procedure: 

• Differential space signal acquisition'. We perform a vertical finite difference operation on the image 
by multiplying the 2D-DFT signal with 1—This operation effectively creates an approximately 


sparse differential image, as shown in Fig. 11(e) in spatial domain and can be reconstructed using 
2D-FFAST. Note, that the finite difference operation can be performed on the sub-sampled data 
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and at no point we access all the input Fourier measurements. The differential hrain image is then 
suh-sampled and reconstructed using a 3 stage 2D-FFAST architecture. Also, since the hrain image 
is approximately sparse, we take 15 delay suh-streams in each of the 3 stages of the 2D-FFAST 
architecture, instead of 3 delay suh-streams as in the exactly sparse case. The 2D-R-FFAST algorithm 
reconstructs the differential hrain image using 56.71% of Fourier measurements. 

• Inversion using fully sampled center frequencies'. After reconstructing the differential hrain image, as 

shown in Fig. |ll(f)[ we invert the finite difference operation hy dividing the 2D-DFT measurements 
with 1 — Since the inversion is not stable near the center of the Fourier domain, only the 

non-center frequencies are inverted. The center region of the 2D-DFT is fully sampled and used in 
the inversion process. 

• Overall we use a total of 60.18% of Fourier measurements to reconstruct the hrain image using the 
2D-R-FFAST algorithm along with the fully sampled center frequencies. The resulting signal-to- 
noise ratio of the reconstructed image is 4.5173 dB. While the reconstruction error is not as good 
as state-of-the-art compressed sensing MRI results, we note that the 2D-R-FFAST has both low 
computational complexity and low sample complexity , which none of the state-of-the-art compressed 
sensing results in MRI can achieve. 


VIII. Conclusion 

We have shown that a 2D sparse DFT with both low sample complexity and low computational 
complexity can be practically achieved with the 2D-FFAST algorithm. We have made the connection 
between the 2D sparse DFT problem and the sparse graph decoding problem and provides theoretical basis 
for our algorithm. Our applications show promise for practical implementation in imaging systems and we 
believe additional incorporation of domain knowledge can further improve the 2D-FFAST performance. 


Appendix A 

Proof of Theorem IIII. II for 2D-FFAST 

In this section we provide a proof of Theorem III.I In ijH, we have shown that for ID signals, for 
all values of the sparsity index 0 < (i < 1, and sufficiently large {k,N), where k = 0{N^), there 
exists a ID-FFAST architecture, that computes a /c-sparse ID-DFT X, using 0{k) sample in 0{k\ogk) 
computations. The 2D-FFAST algorithm succeeds with probability approaching 1, asymptotically in the 
number of measurements. In order to show a similar result for the 2D signals, we use the following 
approach: 
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'Px,o'Px,l 


'Px,2Px,0 

(a) 


Ql 


Qo 

(b) 



Qo 


-Ql 
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Fig. 12. A bi-partite graph representation of relation between the non-zero 2D-DFT coefficients, of a 2D signal x, and the 
observations of a 3-stage 2D-FFAST architecture, (a) A non-zero DFT coefficient with support {i,j) is indexed by a 6-tuple 
(fj,,o,Ty, 1 ,rj,, 2 )), where = i mod and = j mod Vy,e, for £ = 0, 1,2. Each check node is 

indexed by a quadruplet, e.g., check node in stage 0 is indexed by {{rx,Q,rx,i), (fy.o, fy,i))- A non-zero DFT coefficient with 
an index ((rj;,o, fa,,!, rj;, 2 ), (fy,o, »'y,i,ry, 2 )) is connected to a check node {ry,o,ry,i)) in stage 0. (b) A non-zero 

DFT coefficient with support {i,j) is indexed by a triplet (so, si, S 2 ), where st = + Vy^e, for ^ = 0,1, 2. Each check 

node is indexed by a doublet, e.g., check node in stage 0 is indexed by (so,Si). A non-zero DFT coefficient with an index 
(so, Si, S 2 ) is connected to a check node (so, Si) in stage 0. 


We show that, for any given sparsity index 6 and sufficiently large k,N = Nx x Ny, there exists 
a mapping between a 2D-FFAST architecture and a ID-FFAST architecture designed for parameters 
(<5, k, N). In particular, we show that a 2D-FFAST has a hi-partite graph representation corresponding to 
a hi-partite graph representation for a ID-FFAST. The proof then follows from the results in ||T1. For the 
sake of brevity we show the mapping for 6 = 2/3. The mapping extends in a straightforward way for 
any 0 < (i < 1. 

Let {Qo, Ql, Q2} be a set of pairwise co-prime integers such that Qj = F+0(1) and let {Vx,o, 'Px,i,'Px, 2 } 
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and {Vyfl,Vy^i,Vy^2] be two sets of co-prime integers such that Vx,i'Py,i = Qi- Also, let = 
'Pxfi'Px,i'Px, 2 , Ny = VyfiVy,iVy, 2 , and k = Vxfi'Px,i'Pyfi'Py,i- Then, k = 0 {N‘^/^), where N = N^Ny, 
that is, 6 = 2/3. Consider a 3-stage 2D-FFAST architecture with the suh-sampling factors {nxfi-,nyfl) = 
{Vx, 2 ,'Py^ 2 ), {nx,i,ny^i) = {Vx,o,'Pyfl), {nx,2,ny,2) = {Vx,i,'Py,i) for the 3 stages respectively. 

Using the CRT every 2D location (0, 0) < (i, j) < {Nx, Ny), is uniquely represented hy {rxfl, rx,i, rx, 2 ) 
and {ryfi,ry^i,ry^ 2 ), where Vx/ = i mod Vx,t and Vy^^ = j mod Vy^^, for f" = 0,1, 2. Then, a uniformly 
random choice of the 2D-support for a non-zero DFT coefficient corresponds to a uniformly random 
choice of the remainders {rxfi,rx,i,rx, 2 ) and {ryfi,ry^i,ry^ 2 )- Using the suh-sampling-aliasing and the 
circular shift properties explained in Section|V]we obtain a sparse graph, shown in Fig. [T^a), representing 
the relation between the k non-zero DFT coefficients of the 2D signal x, and the bin-observations. Note 
that a non-zero DFT coefficient with a 2D support (f,j) is connected to a check node indexed by 
{rx,o,rx,i) and {ryfi,ry^i) in stage 0. 

Recall that each Qi = Vx/Vy/ for i = 0,1,2. Then, any doublet (0,0) < {i,j) < i'Px/,'Py/) can 
be uniquely represented by an integer q = iVy^e + j- Using this mapping, we convert every doublet 
{rx,e,ry^i) into a single number Si = Vx/Vy/ + ry^i, for i = 0,1,2. Thus, each check node can now 
be represented by a doublet instead of a quadruplet and each non-zero DFT coefficient can now be 
indexed by a triplet instead of a 6-tuple. For example, a check node, in stage 0, with a quadruplet index 
((^x,0) {ryflji^y,!)) can be represented by a doublet (so,si). The re-arranged bi-partite graph with 
this new labeling is shown in Fig [T^b). 

The bi-partite graph of Fig p^b) has k left nodes and QoQi + Q1Q2 + Q2Q0 right nodes. Further, 
each left node has one uniformly random neighbor in each of the 3 stages. This graph is a member of 
the ensemble of bi-partite graphs generated by a 3-stage ID-FFAST architecture, in |[T1, designed for the 
following parameters: {Qo, Qi, Q2} is a set of co-prime integers such that Qi = 0(F), N = nr=o 
and k = QoQi, that is, 6 = 2/3. Thus, the proof follows from the results of lU, for <5 = 2/3. ■ 

Appendix B 

Proof of Theorem IIII.2I for 2D-R-FFAST 

In lITSl . we have shown that a noiseless ID-FFAST framework can be made noise-robust by using 
0(log N), where N is an ambient signal dimension, number of delay-chains per sub-sampling stage. Also, 
as explained in Section |Vj for 2D-DFT, we follow a separable approach and perform 2 independent ratio- 
tests to determine the 2D support of a single-ton bin. Hence, all the results from |[T3l follow and the 
noise robust 2D-FFAST algorithm computes A;-sparse 2D-DFT in sub-linear time of 0{k\og^ N) using 


September 22, 2015 


DRAFT 




27 


0{k log^ N) measurements. 
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